The Dangerous Myth of the Star System
نویسندگان
چکیده
This paper describes a large scale experiment aimed to detect the reliability of users when converting their written opinions on product into a numerical score (e.g. number of stars). The study shows that, due to a number of factors, such a judgment is highly unreliable and, confronted with a uniform gold standard, provides accuracy inferior to a state of art system for opinion detection (namely the Senti-Miner system based on HOLMES (Hybrid Operable platform for Language Management and Extensible Semantics)). In particular, we show that user judgements are strongly biased towards positivity: this might be due to some features of the user interface, but it is highly probable that users are generally more inclined towards positivity when lacking clear criteria to transform a text into a number. Whatever the reasons of this bias might be, it is evident that this behaviour, if confirmed on different data sets, could pose some doubt on evaluation experiments based on user generated assignments as well as on systems whose training comes from the same sources.
منابع مشابه
The Position of Myth in Frazer’s Anthropological Theory
George James Frazer (1854-1941), the spiritual father of myth-ritual school, was bred up in the British tradition of empiricism. Believing in the evolutionary process of culture, Frazer mainly focused his attention on explaining such epistemic forms of thought as magic, religion and science. Accordingly, while interpreting the processes through which magic leads to religion and finally evolves ...
متن کاملInterrogation of a University Classrooms in the Court of Semantics: Managerial Implications
The purpose of this article, within the framework of an interpretive study, was to study the semantics of a universitychr('39')s classrooms to create a critical awareness of the meanings of the symptoms and their functions at the context of physical artifacts, besides their managerial implications. To accomplish this goal, after taking pictures of the structural elements of the studied classroo...
متن کاملارائه الگوریتم شناسایی ستاره بر مبنای رأی‌گیری هندسی به منظور استفاده در ردیاب‌های ستاره‌ای
Star identification is one of the most important stages in attitude determination with star trackers. This can be performed using matching algorithms between observed stars and a master star catalogue. The main challenge in this approach is to provide a fast and reliable identification algorithm that is sufficiently robust in different pointing views of the star tracker optical system in the sp...
متن کاملحل منحنیهای نوری و مطالعه نقش میدانهای مغناطیسی در تغییرات پریود سیستم UV Leo
The solutions of photometric BV light curves for the Algol like system UV Leo were obtained using Wilson-Devinney code. The physical and orbital parameters along with absolute dimensions of the system were determined. It has been found that to best fit the V light curve of the system, assumptions of three dark spots were necessary two on the secondary and one on the primary. The absolute visual...
متن کاملJoint Optimization of Star P-hub Median Problem and Seat Inventory Control Decisions Considering a Hybrid Routing Transportation System
In this paper, we study the problem of integrated capacitated hub location problem and seat inventory control considering concept and techniques of revenue management. We consider an airline company maximizes its revenue by utilizing the best network topology and providing proper booking limits for all itineraries and fare classes. The transportation system arises in the form of a star/star net...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014